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DETAILED ACTION 
Response to Arguments 

Claims 1,16, 24, 32 and 40, applicant argues that the combination of Kikinis (US 
5929849) in view of Adams (WO 96/10888) is improper because Adams and Kikinis 
contain no suggestion or motivation. 

In response to applicant's argument that there is no suggestion to combine the 
references, the examiner recognizes that obviousness can only be established by 
combining or modifying the teachings of the prior art to produce the claimed invention 
where there is some teaching, suggestion, or motivation to do so found either in the 
references themselves or in the knowledge generally available to one of ordinary skill in 
the art. See In re Fine, 837 F.2d 1071 , 5 USPQ2d 1596 (Fed. Cir. 1988)and In re 
Jones, 958 F.2d 347, 21 USPQ2d 1941 (Fed. Cir. 1992). 

In this case, Kikinis discloses an interactive TV system in which the receiver 
receives video stream and accompanying supplemental data file (Dynamic URL) in 
which Dynamic URL is a file having instructions (el. 87 of Fig. 3) that is executed by the 
receiver for enhancing identified identity of an objects or images, i.e., emblem BMW 
(see Fig. 2; Col. 9, lines 35-45) that is overlaid with its associated hyperlink address 
(i.e., URL) on the video stream. Kikinis' s Dynamic URL control routine does not clearly 
disclose instructions/commands for rendering/overlaid objects/images with its 
associated hyperlink address (URL) on the video stream and for setting transparent 
areas to a key color. 
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Adam, in a similar art, discloses an interactive TV system in which the receiver 
also receives video stream and accompanying associated data stream of associated 
data packet 84 includes an associated data payload that specifies interactive video 
command and control functions that perform functions such as placement of graphic 
objects on the display 12, rendering graphic objects on the display by setting specific 
screen background color of the object to be transparent (set to a key color); see page 
21 , lines 13-28 (page 20-22, lines 10); Adam further discloses video packets, audio 
packets, and associated data packets includes time stamp for time synchronization with 
the video stream when the graphical object is overlaid on the video stream at specific 
location of the screen (page 19, lines 16-22; page 23, lines 13-30). Thus, Adams 
clearly discloses instructions for rendering/overlaid objects/images on the video stream 
display in a synchronization manner. Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to modify Kikinis with Adams' 
s object oriented instruction set so to enable a content programmer to able to create a 
video stream display screen from a programming studio and to flexibly control area 
around the video stream display including the definition and placement of 
objects/text/images over the video stream display, as suggested by Adams 1 summary 
page 5-8. 

Moreover, the reason why one of ordinary skill in the art would be motivated to 
modify Kikinis with Adams is simply, because the combination is obvious. One of 
ordinary skill in the art would recognize that modify Kikinis Dynamic URL control 
routines with Adams' s object oriented programming command set would be 
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advantageous, since frameworks are based on object technology in ease of 
programming, extensibility, reuse of code, and integration of software from different 
vendors and (in some object-oriented programming models) across programming 
languages, in this instant Adams' "object oriented command set" of setting specific 
screen background color of an object to be transparent in order to overlay the object on 
the video stream display, see page 21, lines 10-page 22, line 10. 

Therefore, Examiner submits that combination of Kikinis and Adams with the 
above motivation and suggestion is proper and not improper as alleged by Applicant, 
and as such, a prima facie case of obviousness has been established as set forth by 35 
U.S.C. § 103(a). 

Claim Rejections - 35 USC § 101 

35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefore, subject to the 
conditions and requirements of this title. 

1 . Claims 15 and 32 are rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter 

Claims 15 and 32 constitute a storage medium having computer instructions 
per se with no pre- or post- processing implemented within a device thereupon. The 
claimed subject matter fails to produce a useful, concrete or tangible result because 
the storage medium with executable instruction for performing/executing a process 
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is an abstract idea in which the storage medium could be, for example, "a human 
memory" that stores/memorizes the computer executable instructions for 
performing/executing such process. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 1-43 and 45-50 are rejected under 35 U.S.C. 103(a) as being unpatentable 

over Kikinis (US 5929849) in view of Adams (WO 96/10888). 

Claim 1 , Kikinis discloses a method comprising the following steps: 

"transmitting a video stream" reads on the received video stream for 
displaying the video on Fig. 2C because Kikinis must have a mean to transmit the 
video stream, i.e., CATV headend . 

"formatting supplemental data files in a graphical markup language" reads on 
the 'Dynamic URL' control routine in which is notoriously well known in the computer 
art to be files with CGI extension or Scripts with coded syntax in different format, i.e. 
HTML, DHTML (Dynamic HTML), XTML (Extensible HTML) in which the Kikinis' 
system must formatted at the Server/headend (col. 8, lines 5-18 and Col. 10, lines 
18-25). 
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"each supplemental data file having instruction for rendering over on the video 
stream" reads on the executing the 'Dynamic URL 1 by a browser to render over the 
video as shown on Fig. 2C (see Fig. 3A, el. 87 and 91 ; Col. 8, lines 5-37); 

"transmitting the supplemental data files along with the video stream" is met 
by Kikinis (Fig. 3A, ei. 83). 

Kikinis fails to disclose "wherein formatting comprises setting transparent 
areas of each hyperlink overlay to a key color." 

Adams, in a similar art, discloses an interactive TV system in which the 
receiver also receives video stream and accompanying associated data stream of 
associated data packet 84 includes an associated data payload that specifies 
interactive video command and control functions that perform functions such as 
placement of graphic objects on the display 12, rendering graphic objects on the 
display by setting specific screen background color of the object to be transparent 
(set to a key color); see page 21, lines 13-28 and page 20-22, lines 10; Thus, 
Adams clearly discloses instructions for rendering/overlaid objects/images by setting 
specific screen background color of the object to be transparent (set to a key color) 
on the video stream display in a synchronization manner. Therefore, it would have 
been obvious to one of ordinary skill in the art at the time the invention was made to 
modify Kikinis with Adams' s object oriented instruction set so to enable a content 
programmer to able to create a video stream display screen from a programming 
studio and to flexibly control area around the video stream display including the 
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definition and placement of objects/text/images over the video stream display, as 
suggested by Adams (pages 5-8). 

Claim 2, Kikinis further discloses "formatting the supplemental data files in 
HTML" see Col. 9, lines 60-65+. 

Claim 3, Kikinis does not clearly discloses a step of transmitting timing 
specifications with the supplemental data files indicating time for displaying the 
hyperlink overlays; however, Kikinis discloses a step of transmitting the 
supplemental data files (Dynamic URL) for display an hyperlink overlay, as 
discussed in claim 1. 

Adams discloses a timing specification (time stamp) is transmitted with 
associated data packets (supplemental data files) includes time stamp, i.e., time 
synchronization with the video stream when the graphical object is overlaid on the 
video stream at specific location of the screen (page 19, lines 16-22; page 23, lines 
13-30). Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify Kikinis with Adams to have a timing 
specification (time stamp) transmits with associated data packets, as taught by 
Adams, so additional display information could be presented to user and in sync 
along with the video and audio information (page 5, lines 5-15). 

Claim 4, Kikinis must have a storage medium having computer executable 
instructions for performing steps in claim 1, as disclosed. 
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Claim 5, "receiving the video stream and accompanying supplemental data 
files" reads on Kikinis (Fig. 3A, el. 83); 

"displaying the hyperlink overlays in conjunction with the video stream" reads 
on (Fig. 2C in which el 71 and 57 overlay with the video stream). 

Claim 6, Kikinis further discloses wherein the displaying step comprises 
launching an HTML-compatible browser to display the hyperlink overlays (Col. 6, 
lines 5-7). 

Claim 7, Adams further discloses the displaying step comprises displaying the 
video stream only in the areas of the hyperlink overlays that are set to a key color 
(page 23, lines 10-page 24, lines 10). 

Claims 8 and 10, Kikinis further discloses wherein the displaying step comprises 
launching an HTML-compatible browser to display the hyperlink overlays (Col. 6, 
lines 5-7). 

Kikinis does not clearly disclose the formatting step comprises setting 
transparent areas of each hyperlink overlay to a key color, the displaying step 
comprises displaying the video stream only in the areas of the hyperlink overlays 
that are set to a key color. However, Kikinis discloses hyperlink overlay. 

Adams discloses "the step of setting transparent areas of each associated 
graphic/text items overlay to a key color 1 ' in which associated data packet 84 
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includes an associated data payload that specifies interactive video command and 
control functions that perform functions such as placement of graphic objects on the 
display 12 ? rendering graphic objects on the display by setting specific screen 
background color of the object to be transparent (set to a key color); see page 21 , 
lines 13-28 and page 20-22, lines 10; Thus, Adams clearly discloses instructions for 
rendering/overlaid objects/images by setting specific screen background color of the 
object to be transparent (set to a key color) on the video stream display in a 
synchronization manner. Adams further discloses the displaying step comprises 
displaying the video stream only in the areas of the hyperlink overlays that are set to 
a key color (page 23, lines 10-page 24, lines 10). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Kikinis with Adams' s object oriented 
instruction set so to enable a content programmer to able to create a video stream 
display screen from a programming studio and to flexibly control area around the 
video stream display including the definition and placement of objects/text/images 
over the video stream display, as suggested by Adams (pages 5-8). 

Claim 9, Kikinis does not clearly disclose the formatting step comprises setting 
transparent areas of each hyperlink overlay to a key color, the displaying step 
comprises displaying the hyperlink overlay and using color keying hardware that 
displays video only in the display areas that are set to a key color; However, Kikinis 
discloses hyperlink overlay. 
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Adams discloses "the step of setting transparent areas of each associated 
hyperlink overlay to a key color" in which associated data packet 84 includes an 
associated data payload that specifies interactive video command and control 
functions that perform functions such as placement of graphic objects on the display 
12, rendering graphic objects on the display by setting specific screen background 
color of the object to be transparent (set to a key color); see page 21 , lines 13-28 
and page 20-22, lines 10; Thus, Adams clearly discloses instructions for 
rendering/overlaid objects/images by setting specific screen background color of the 
object to be transparent (set to a key color) on the video stream display in a 
synchronization manner. Adams further discloses the displaying step comprises 
displaying the graphic/text items overlay and using color keying hardware that 
displays video only in the display areas that are set to a key color (page 14, lines 5- 
15; page 18, lines 4-17; page 23, lines 10-page 24, lines 10). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Kikinis with Adams' s object oriented 
instruction set so to enable a content programmer to able to create a video stream 
display screen from a programming studio and to flexibly control area around the 
video stream display including the definition and placement of objects/text/images 
over the video stream display, as suggested by Adams (pages 5-8). 
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Claim 1 1 , Kikinis further discloses an additional step of displaying content 
targeted by such hyperlinks in response to selecting such hyperlinks (Col. 8, lines 
54-Col. 9, lines 8). 

Claim 12, Kikinis further discloses the formatting step comprises including 
hyperlinks in the Hyperlink overlays (Dynamic URL, Col. 8, lines 54-Col. 9, lines 8), 
the method further comprising an additional step of replacing any currently displayed 
Hyperlink overlay with content targeted by such hyperlinks in response to selecting 
such hyperlink (Col. 9, lines 60-Col. 10, lines 55). ' 

Claim 13, Kikinis further discloses the formatting step comprises including 
hyperlinks in the Hyperlink overlays (Dynamic URL, Col. 8, lines 54-Col. 9, lines 8), 
the method further comprising an additional step of opening new viewing windows 
for displaying content targeted by such hyperlink (the selection of Kikinis URL link 
would result in opening a new window in which is well known in the Computer Art 
under Windows environment to display additional information; Col. 9, lines 60-Col. 
10, lines 55). 

Claim 14, Kikinis further discloses the formatting step comprises including 
hyperlinks in the Hyperlink overlays (Dynamic URL, Col. 8, lines 54-Col. 9, lines 8), 
the method further comprising an additional step of launching application programs 
as required to render content targeted by such Hyperlink (the selection of Kikinis 
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URL link would result in opening application programs for opening a new window in 
which is well known in the Computer Art under Windows environment to display 
additional information; Col. 9, lines 60-Col. 10, lines 55). 

Claim 15, Kikinis further discloses a storage medium (fig. 5,el. 49, 47 and 45) 
having computer executable instructions (Col. 6, lines 1-8) for performing steps in 
claim 5, as disclosed. 

Claim 16 is analyzed with respect to claims 1 , 5 and 7. 

Claim 17 is analyzed with respect to claim 3. 

Claims 18, 25 and 33 are analyzed with respect to claim 6. 

Claims 19, 26 and 34 are analyzed with respect to Claim 9. 

Claim 20 is analyzed with respect to Claim 1 1 . 

Claim 21 is analyzed with respect to Claim 12. 

Claim 22 is analyzed with respect to Claim 13. 

Claim 23 is analyzed with respect to Claim 14. 

Claim 24, Kikinis discloses a method comprising the following steps: 
Receiving a video stream (see Fig. 1 and 2AC in which the received video 

stream is displaying) 

Associating one or more hyperlink pages with the video stream (Fig. 2B and 

3A, el. 83; Col. 7, lines 10-27); 
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Displaying the hyperlink pages on a display (Fig. 2C in which el 71 is 
displayed along with el. 57 overlay with the video stream when the user uses the 
cursor 70 to select el. 57); 

Displaying the video stream on the display in areas (see Fig. 2A and 2C in 
which the video stream is displayed on the display area 55 surrounding the el. 57 
and el. 71). 

Kikinis does not clearly disclose the hyperlink pages having transparent areas 
that are set to a key color; and displaying the video stream on the display in area of 
displayed hyperlink page that are set to a key color; however, Kikinis discloses 
displaying the video stream on the display in areas (see Fig. 2A and 2C in which the 
video stream is displayed on the display area 55 surrounding the el. 57 and el. 71). 

Adams discloses transparent areas of each associated hyperlink overlay is 
setting to a key color in which associated data packet 84 includes an associated 
data payload that specifies interactive video command and control functions that 
perform functions such as placement of graphic objects on the display 12, rendering 
graphic objects on the display by setting specific screen background color of the 
object to be transparent (set to a key color); see page 21 , lines 13-28 and page 20- 
22, lines 10; Thus, Adams clearly discloses instructions for rendering/overlaid 
objects/images by setting specific screen background color of the object to be 
transparent (set to a key color) on the video stream display in a synchronization 
manner. Adams further discloses displaying the graphic/text items overlay and 
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using color keying hardware that displays video only in the display areas that are set 
to a key color (page 1 4, lines 5-1 5; page 1 8, lines 4-1 7; page 23, lines 1 0-page 24, 
lines 10). 

Adams further discloses the displaying step comprises displaying the video 
stream only in the areas of the hyperlink overlays that are set to a key color (page 
23, lines 10-page 24, lines 10). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Kikinis with Adams' s object oriented 
instruction set so to enable a content programmer to able to create a video stream 
display screen from a programming studio and to flexibly control area around the 
video stream display including the definition and placement of objects/text/images 
over the video stream display, as suggested by Adams (pages 5-8). 

Claims 27 and 35 are analyzed with respect to claims 25 and 26. 
Claims 28 and 36 are analyzed with respect to Claim 1 1 . 
Claims 29 and 37 are analyzed with respect to Claim 12. 
Claims 30 and 38 are analyzed with respect to Claim 13. 
Claims 31 and 39 are analyzed with respect to Claim 14. 



Claim 32 is analyzed with respect to method claim 24 in which Kikinis in view of 
Adams further discloses a computer-readable storage medium (Kikinis, fig. 1, el. 49 
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stores control routines and Adams fig. 2, el. 54 and 60 store various application 
program, page 15, lines 1-8). 

Claim 40, Kikinis discloses a video broadcast system comprising: 
A broadcast source (Fig. 1, not show) broadcasts video stream and 
accompanying supplemental data file (Dynamic URL; Fig. 3A shows received 
broadcasts video stream and accompanying supplemental data file at el. 83), "each 
supplemental data file having instructions for rendering a hyperlink overlay on the 
video stream" reads on the 'Dynamic URU in which is notoriously well known in the 
computer art to be file with CGI extension or Script with coded syntax in different 
format, i.e. HTML, DHTML (Dynamic HTML), XTML (Extensible HTML) in which the 
Kikinis 5 system must formatted at the Server/headend (col. 8, lines 5-18 and Col. 10, 
lines 18-25). 

A receiver (Fig. 1) configured to receive the video stream and accompanying 
supplemental data file at el. 83 of Fig. 3A and to display the overlays in conjunction 
with the video stream (see fig. 2C). 

Kikinis does not clearly disclose wherein the receiver comprises color-keying 
hardware that displays video only in the display areas that are set to a key color, the 
hyperlink overlays having transparent areas that are set to a key color. However, 
Kikinis discloses hyperlink overlay. 

Adams discloses "the step of setting transparent areas of each associated 
hyperlink overlay to a key color" wherein the associated data packet 84 includes an 
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associated data payload that specifies interactive video command and control 
functions that perform functions such as placement of graphic objects on the display 
12, rendering graphic objects on the display by setting specific screen background 
color of the object to be transparent (set to a key color); see page 21 , lines 1 3-28 
and page 20-22, lines 10; Thus, Adams clearly discloses instructions for 
rendering/overlaid objects/images by setting specific screen background color of the 
object to be transparent (set to a key color) on the video stream display in a 
synchronization manner. Adams further discloses the displaying step comprises 
displaying the graphic/text items overlay and using color keying hardware that 
displays video only in the display areas that are set to a key color (page 14, lines 5- 
15; page 18, lines 4-17; page 23, lines 10-page 24, lines 10). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Kikinis with Adams' s object oriented 
instruction set so to enable a content programmer to able to create a video stream 
display screen from a programming studio and to flexibly control area around the 
video stream display including the definition and placement of objects/text/images 
over the video stream display, as suggested by Adams (pages 5-8). 

Claim 41 is analyzed with respect to Claim 2. 
Claim 42 is analyzed with respect to Claim 3. 
Claim 43 is analyzed with respect to Claim 6. 
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Claim 45, Kikinis discloses a receiver for receiving and displaying video stream 
(Fig. 1) comprising hardware 51, 53 for displaying video streams and bit-map 
images to a user; a processor (Fig. 1, el. 19). 

Kikinis does not clearly disclose the displaying hardware including color keying 
hardware that displays video in display areas that are set to a key color; access 
means for reading supplemental data files that have instructions for rendering bi- 
mapped hyperlink overlays in conjunction with the video stream at the indicated 
time; a data processor that reads the supplemental data files in response displays 
the hyperlinks overlays at the indicated times, wherein the hyperlink overlays have 
transparent areas that are set to a key color, the hyperlink overlays thus appearing 
to overlay the video streams; However, Kikinis discloses a step of transmitting the 
supplemental data files (Dynamic URL) for display an hyperlink overlay as discussed 
in claim 1. 

Adams (Fig. 1, el. 10) discloses display hardware 12 for displaying video streams 
and bit-map images to users. The display hardware including color- keying hardware 
that displays video in display areas that are set to a key color (Fig. 2, el. 56); Access 
means 54, 60 for reading supplemental data ('associated data 1 ) files that have 
instructions for rendering bi-mapped (graphic/text items) overlays in conjunction with 
the video stream at the indicated time (time stamp; page 15, lines 9-16; page 19, 
lines 16-22 and page 23, lines 13-20); a data processor 52 that reads the 
supplemental data ('associated data 1 ) files in response displays the overlays at the 
indicated times (page 19, lines 16-22 and page 23, lines 13-20), wherein the 
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overlays have transparent areas that are set to a key color, the overlays thus 
appearing to overlay the video streams (page 20, lines 18-page 21 , lines 10; page 
23, lines 10-page 24, lines 10); Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to modify Kikinis with 
Adams so to enable the receiver to define windows according to the specifications 
provided by the associated data to display received video data stream within the 
defined windows (page 22, lines 10-page 23, lines 2). 

Claim 46, Kikinis in view of Adams further discloses an HTML-compatible 
browser that the data processor executes to display the hyperlink overlays (Col. 6, 
lines 5-7). 

Claim 47, Kikinis in view of Adams further discloses displaying content targeted 
by such hyperlinks in response to selecting such hyperlinks (Col. 8, lines 54-Col. 9, 
lines 8). 

Claim 48, Kikinis in view of Adams further discloses replacing any currently 
displayed Hyperlink overlay with content targeted by such hyperlinks in response to 
selecting such hyperlink (Col. 9, lines 60-Col. 10, lines 55). 

Claim 49, Kikinis in view of Adams further discloses opening new viewing 
windows for displaying content targeted by such hyperlink (the selection of Kikinis 
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URL link would result in opening a new window in which is well known in the 
Computer Art under Windows environment to display additional information; Col. 9, 
lines 60-Col. 10, lines 55 in combination with the teaching Adams for graphics 
rendering). 

Claim 50, Kikinis in view of Adams further discloses the processor is 
programmed to launch application programs as required to render content targeted 
by such Hyperlink (the selection of Kikinis URL link would result in opening 
application programs for opening a new window in which is well known in the 
Computer Art under Windows environment to display additional information; Col. 9, 
lines 60-Col. 10, lines 55). 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Hai Tran whose telephone number is (571) 272-7305. 
The examiner can normally be reached on M-F. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Christopher C. Grant can be reached on (571 ) 272-7294. The fax phone 
number for the organization where this application or proceeding is assigned is 703- 
872-9306. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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